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ABSTRACT 


The aim of this thesis is to review the literature 
relating to the distribution and independence of quadratic 
forms in normal random variables. In Chapter II, we have 
discussed Craig's theorem and its generalizations to correlated 
and non-central cases. Matern's result for testing the indepen- 
dence of non-negative quadratic forms has been discussed. 

In Chapter III, several results for testing whether 
a given quadratic form follows a chi-square (central and non- 
central) distribution have been reviewed. In this direction, 
Cochran's theorem and Craig's theorem and their generalizations 
have been discussed. These discussions include the case when 
V (Var.-Cov. matrix) is singular. Finally, we have given some 


applications of the results discussed above. 
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CHAPTER I 


INTRODUCTION 


"Quadratic forms enter into many statistics associated with 
normally distributed random variables. Formal analysis of variance, 
for example, is entirely concerned with statistics constructed from 
quadratic forms in random variables representing original observations 
(or transformations thereof)."* The frequent occurence of quadratic 
forms in the study of ANOVA, Regression Analysis, Econometrics and 
many other related fields, makes it necessary to investigate their 
properties. The complete justification of various TES: muiay meh beg) 
studies involves the independence of quadratic forms and the condi- 
tions under which a given quadratic form follows the ve - distribution. 
The fundamental theorems in this direction are Craig's theorem 
(Theorem 1) and Cochran's theorem (Theorem 15). 

In this thesis our studies are confined to quadratic forms 
in normal random variables only, and the basic aim is to review the 
literature pertaining to these two theorems and their subsequent 
developments. Basically we have followed a matrix approach in pre- 
senting the results. 

In Chapter II, we state and prove Craig's theorem, which 
gives a criterion for testing the independence of two quadratic forms 
in normal random variables with mean zero. Extensions of this 


theorem to the correlated case and non-central case as given by 


x . 
Quoted from Continuous Univariate Distributions by Norman L. 
Johnson and Samuel Kotz. New York, Houghton Mifflin, 1970. 
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A.C. Aitkin [2] and 0. Carpenter [8] respectively are discussed. 
Apart from the Craig's criterion for testing the independence of two 
quadratic forms (Theorem 1), B. Matern [25] has given another 
criterion for the independence of non-negative quadratic forms in 
normally correlated variables. This result along with its extension 
to arbitrary quadratic forms as given by Y. Kawada [17] has been 
discussed. The chapter is concluded by proving a criterion which 
deals with the independence of quadratic forms of the type 
Q(X, »X55+--sX) where the X's follow a multivariate normal 
distribution. 

In Chapter III, Cochran's theorem which gives "a 
necessary and sufficient condition for several quadratic forms to 


wt 


be independently distributed as e has been proved. The 
extensions of this theorem to the correlated case as given in [9], 
[4] and [22] have been discussed. Also various results which 

deal with conditions under which Q = X'AX follows a eater ria 
bution, for X multivariate normal with variance-covariance matrix 
V (possibly singular) have been discussed. In these discussions 
various results on idempotent matrices have been used. The knowledge 
of idempotent matrices and their properties has been assumed. 


The last chapter is devoted to some applications of 


various results established in the previous two chapters. 
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CHAPTER IL 


INDEPENDENCE OF QUADRATIC FORMS 


§2.1. At various places in the study of statisticas we encounter linear, 
bilinear and quadratic forms. The t-test, variance ratio test and 
certain other tests of significance are valid only on condition that 
the linear, quadratic and bilinear forms concerned are statistically 
independent. In the present chapter we shall confine our studies to 
the independence of quadratic forms in normal random variables only. 

The central theorem of this chapter is the one due to 
A.T. Craig [7]. But earlier W.G. Cochran [5] obtained another result 
which is not so easy to apply as is Craig's result. Because of the 
importance of Craig's thoerem, H. Hotelling [13] and A.C. Aitkin [2] 
also tried to prove this elegant theorem. Later J. Ogawa [27] gave 
an algebraic proof of Craig's theorem after pointing out some mistakes 
in the original proofs of Craig and Hotelling. 

Craig's theorem as stated in [7] deals with independent rv's 
following univariate normal distribution with mean zero. Later 
A.C. Aitkin [2] obtained an extension to correlated case and 
O. Carpenter [8] extended this theorem to the case of noncentral 
normal variates with equal variance. 

All these results stated above deal with the quadratic forms 
Q(x, 5+++5x)) where x,'S follow univariate normal distribution; J. Ogawa 
[27] proved a criterion for testing the independence of two quadratic 
forms when the random sample is drawn from multivariate normal population. 


Apart from the Craig's and Cochran's result, B. Matern [25] 
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has given another criterionwhich deals with non-negative quadratic 
forms in normally correlated variables. Later Y. Kawada [17] 
extended Matern's result from non-negative case to general case. 
Finally, it is worth noting that the central theorem of 
the present chapter, i.e., Theorem 1, has been attributed in 
literature to A.T. Craig; but K. Matusita [26] page 82; has claimed 
that he had this result in 1943 independently of A.T. Craig and thus 


gives another independent proof in [26]. 


§2.2. The central theorem for the present chapter is one due to 
A.T. Craig [7] in which we suppose that x, N(O,1) are independently 


distributed rv's. eE* 'O are two quadratic forms in 


ise Q» 


Xp oXy ores oX, with associated matrices (real and symmetric) A _ and 


B respectively, then: 


Theorem 1: (Craig): A necessary and sufficient condition that Q, 
and Q, are independent in the probability sense is that the product 
AB = 0. 

Here we give Ogawa's proof (see [27]) which makes use of 


the following lemma for its proof (see [27] page 89). 


Lemma 1: Let the non-zero characteristic roots of real symmetric 


matrices A, B and C = A+B be Pies? 


»B and Yysloete oY, respectively. If the relations 


Bose 


128o2°°° 


s = qtr and 


6 ok wy anaes 
at bopita te ube - posit, 

feminio exit ;58 een | ast salam sl | Aue ae on 7 scab 

sunt bor gtsid .T)A io" vtdnehnagah ri irc ath pulcnebon A 

aan eee eee aos sn ace 

. se fd 

o2 spb sno 2t wsdqetio: ie opiate ae 

qitnsbeagebrt sie) (f,0Man x joe neg Hote an utd 

Pema! stgnebalip pwd = 7 af ig? Sai ati 

bie” A (ota toumes bak koe) asa Patae base Soean’ alae ed 


tae « 


a 


vy 


. i ; 
AL S607 nolaibnés Wasishpiue bon \(ieeesaan 4 vivinioy. J aezet : 


; : 
soubierg -e4 dads ak ofupe ythitdadarg Bet at dréhosyshot ste 
7 Ph 7 
: = 


é 7 : Me a =) 
ig adi cocina dobden({ TS] See) venta a'pungd Svig. 4p -s 


bella tis ate 


~ 


hold, then we have the relation AB = BA = 0. 


Proof of the Theorem: 
Te M(t, ,t,) denotes the joint moment generating 
function of Qa and Q, then it can be shown (see [15], p. 385) 


-(1/2) 
M(t,.t,) = |To2t Aa2e8| ; 


Consequently Q are independent iff 


ae Q5 
M(t, ,t,) x M(t, ,0)M(O,t ) 


ieety, |I-2t A-2t.B| Shite? as ie |1-2t,B| (ct) 
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Cect.5 [> page 45) 


We shall establish the equivalence of (1.1) and the 
condition AB = Q. 


Suppose AB = 0; 


(1-2t, A) (1-2t,B) (1-2t A-2t,B) 
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up 


Conversely suppose (1.1) holds; since it holds for all real values 


1 : 
Offset and. it holds when t, = ty = 5 (say), substituting 


iL 2 
Pe Se eS ae - in (1.2), we have 


n 


|x1-A| + |xI-B| = x |xI-B-A|_ . (1.3) 


This relation shows that the non-zero characteristic values 


of A+B are identical with those of A and B as awhole. Let 
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q 
roots of A, B and AtB respectively. Then the smallest degree 


term of: the ch. polynomial |xI-A| is 
q es 
(1) Gat oes 
; i 
i=1 


Similarly 
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are respectively the smallest degree terms of the ch. polynomials 
| xI-B| and |xI-B-A| respectively. 
Therefore smallest degree terms on both sides of (1.3) 


become 


q t : s a 
(-1) 1%, loa: I Bx" (qtr) A en 1 y,)"" Ss 
= j=l k=1 


respectively. 
Now because of the equality in (1.3) these must be the 
same, consequently 
q r s 
s = qtr and Golconda la Be) eal cy, 
=1 * j-1 J) ei * 
Therefore conditions of Lemma 1 are satisfied and thus it follows 
(from Lemma 1) AB = 0, / 
Because of the importance of this theorem many statisticians 
tried to reprove this theorem differently, Hotelling [13] gave quite 


a rigorous proof of this theorem, but unfortunately both the original 
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proof of Craig [7] as well as Hotelling's [13] have some mistakes 
as pointed out later by Ogawa [27]. For the defect in Hotelling's 
proof see [27] page 95. 

Theorem 1 as stated above deals with uncorrelated variates. 
The following is an extension due to Aitkin [2] of Theorem 1 to 


correlated variates. 


Theorem 2: Let XoXo eee KX, be normal random variables with mean 
zero and variance covariance matrix V. If Qa = X'AX and 
Q, = X'BX (where X!' = (x) 5+++ 5%) are two quadratic forms, then 


Q, and Q, are independent iff AVB = 0. (V_ positive definite.) 


Proof: Since V is positive definite it admits a real square root, 


ee 


- 2 
Consider the transformation Y = V an dx, Then E(YY') =I, 


i.e., Y' = (y.,...,y_) are uncorrelated variates with unit variance. 
£ n 


becomes ytyl/eayl/2y 
Qa 


eZ eee 
and Q, becomes yy / BV / Ne 


Ae Applying Theorem 1 now we have QQ, and Q, independent iff 


Pa 
yil2 yh 2yh/2p yl/ ehG 


Lee v ‘“AVBV = 0 <=> AVB=0. / 


Before Craig's result (Theorem 1), Cochran [5] obtained the 


following condition for testing the independence of two quadratic 
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forms in independent N(Q,1) variates. However Craig's result is 


relatively easier to apply. 


Theorem 3: Let Xp oXy ores eX, be normally and independently 


distributed with zero mean and unit variance; then the quadratic 


forms Qa = (4)X'AX and Q, (4).X'BX are independent iff 
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Proof: If M 


AB? (M,), (M,) denote the characteristic functions of 


A 
Qa» Q, 62) and (Q.) respectively, then it can be shown 


(ef. -[30]) 
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and result follows immediately on noting that Q) and Q, are 
independent iff Map = My 2 M,: 

§2.3. In this section we shall discuss briefly some of the results 
which will be used quite implicitly in the remainder of this chapter 
and in the subsequent chapters. Because of their importance we shall 


explicitly state these results here and if necessary proofs will be 


cublined. 


shawibevp: oh rot aa 
Th Gran 


~ }e.axetl - lajaeett = \aysieasit| | 7 
7 a0% 


th 26 bom clteivestsesads 2d) saonab A) s «(4 van iz saoees 
nuone Si mrs 2) 1587 vhoviaowgess (39) bas. ot EE 
ON tigak-dyo=7 * al id i 
(S\ hie - a 
: jAgpiei] 


(S\ > \a.ai-2 - 


3h 0 bem 0 °Se4) gabon nt tUssethonel ello? 2kudex 


<< 


etives? 92 To rsh “¢ 


setae ee 


Let Q = X'AX be a quadratic form in variables (not 
necessarily random) (XX 90+ 9X) = X', with associated (real) 
matrix A. Obviously without any loss of generality A can be 
assumed to be symmetric. Then there exists (cf., [14], page 255) 


an orthogonal transformation X = TY such that 
r 2 
= Nef 1.4) 
Q ) 75 ( 


where Aporgarerod, are non=zero eigenvalues of A; m= rank of A. 


Here we recall the following: 
Definition: If A is the real symmetric matrix associated with the 


quadratic form Q; then the DEGREES OF FREEDOM of Q is defined to 


be the rank of A. 


Theorem 5: Let X!' = (x) 9% x): Suppose X is N(y,V) 


D2. te 


(V non-singular), then nae cumulant of xX'AX is 


K(X'AX) = ee ey ECA aril CIA (125) 
(where tr(AV) means trace of AV). 


Proof: Let M.(t) denote the moment generating function of 


Q 


quadratic form Q = X'AX. Then it can be shown (see for example [30] 


page 55) that, 
My (t) = Mreoeay) 1! o exp {- > u'[Z-(1-2tav) +] vy} 


Since cumulant generating function is the logrithm of the moment 


generating function, we have 
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1 1 Shee 
- 5 log|1-2tav |- > y'[1-(1-2eav) "vy. (1.6) 


Using the convention ee of xX" to denote the uy th 


characteristic root of X" then for sufficiently small |t| we 


have 


n 
il 
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Also by direct binomial expansion, for sufficiently small | 
een P eM) ee ee 
Making these substitutions in (1.6) and comparing the coefficient 
r 
Of ith awe weet (Cle 5); 


Theorem 6: Let X be N(uy,V), with V non-singular. Then 


(i) E(X'AX) = tr(AV) + yp'Au 
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1 
(44) Var (X'AX) = 2 tr(AV)* + 4y"AVAy 
(iii) Cov (X'AX,X'BX) = 2 tr(AVBV) + 2," (AVB+BVA) y 


(iv) Cov (X,X'AX) = 2VAy . 


Proof: (i) Since X'AX is a scalar quantity, 
X'AX = tr(X'AX) 
= tr(AXX') (tr(ABC) = tr(BCA) = tr(CAB)) 


E(X'AX) = E(tr(AXX')) = tr E(AXX') = tr(AE(XX')) 
But E(XX') = V + py’ , therefore 


E(X'AX) erent 


i} 
ct 
Le 


AV + tr(Aun') 


i} 
ct 
5 


AV + tr(u'Ap) 


i} 
ct 
5 


tr AV + p'AL 


(ii) It follows immediately from Theorem 5 on taking 


(iii) Consider the quadratic form 
X'AX +X!’ BX =X! (AtB)X .. 


Var (X'AX+X'BX) = Var(X'AX) + Var(X'BX) + 2 Cov(X' AX, X'BX) 


and 


var(X"' (AtB)X) = 2 tr[{(AtB)V]~ + 4u! (A+B) V(AtB) U 
(from. part (ii)) 


2 tr[AVv]7 + 2 tr[BV]- + 4 tr [AVBV] 


+ 4p'AVAy + 4u'BVBu + 4y' [AVB+BVA] u 


L(an0) 17) = (A8dat = FORA} 2 
. CC ERAS UREAE oe = Can tssy2"s (anna 
, 


ot a a 


(Vip ey yA’ = Gentes 7 
ab aad Va 32 : 
ye elas ae 

whey * VAo-ad =H 


gr ied ce Ee oedema t ybashagemed eeel lot I Cha) 


ate Xk 2 
| (ait aa wo 5 +  OnRLe Eet 
1 @ —- oe 
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= Var (X'AX) + V(X'BX) 


+ 4{tr(AVBV) + y'(AVB+BVA) u} 
Hence Cov(X'AX,X'BX) = 2 tr(AVBV) + 2y'(AVB+BVA) yp . 


(iv) Cov(X,X'AX) = E {(X-) (X'AX-E(X'AX)) } 


= E{(X-n) (X'AX-trAV-py' Ap) } 


E{(X-y) [(X-u) 'A(X-p)+2 (X-p) 'Ap-trav] } 


2E {(X-p) (X-p) Ay} . 


(*, First and third moments of (X-u) are zero.) 
dse., Cov (X,Z'AX) = 2VAy . 
The following useful results are corollaries of Theorem 6. 


Corollary: If xX is, N(0O,V), ‘then 
(i) E(CX'AX) = tr(AV) 
oe ' 2 
Git)” Var (x AX) = 24tr(Av) 
(14i1) Cov (X'AX,X'BX) = 2 tr(AVBV) (i) 


Now we shall state a theorem which deals with matrices 


and will be used frequently in Chapter III, (cf., [7]). 


Theorem: /< Let Al jA,....,A be a collection of n Xn _ symmetric 
— iL aeZ m 8 
matrices where the rank of A. is Py> and let A= ) A, ; 

i=1 


where the rank of A is p. Consider the four conditions: 


Cc) 2. Each A, is an idempotent matrix. 


Cus eae: a =O) (null matrix) forall oi) #7. 


ie 

- : : — ce ¢ 
. & ‘A)*ys wv 0: 2 
= 
= 


{CM VERN 2 sa 

{ Cun *yoihasta mn 

(MAS ~ipA CUB) SCRA" aa yak = 
» (te yt 


| | | 
(.ores Sie {y-%) 26 etreniod betuls fetes saat 5); 


. uA = YRNERY) on yas : 


8 ost! 2 aaltetl oreo. woe aude? 1o?aau gebwat od on | 
| | ashy - diane at 4% a a : 

CNyad =. CT A a 

“wars bom (XA °K) dav a 


J 


: 


fk) WavATsS < eat woo! sl 
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éontasne die alweb | dota merosda aw Won 
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C, : A is an idempotent matrix 


: 

Crate ao De De: 
4 fate 2 
Then the following are true. 


Gi) EGS and. Ce imply, 1G 


il 21 2% 
Cit) C, and C, imply C, 
(iii) Cy and Cc, imply C3 ; 
(iv) Any two Ci» C, and Cy imply all four Cis 
Co» C3 and C,- 
(v) C, and C, imply C, and C.. 
Proof: (i) We have 
A= A’ = ( 5 we = y ee: Des (1.8) 
i=l i=1 2 : 


i 
> 
ob 
Cd 
> 
kr 
> 


Therefore, 
Tr(A) = Tr(A) + Tr( } AjA,) 
i#j 


hence, 


or equivalently 


Es y ; : ” 4 
a = 7 ria imp rr, faaey 
ro 1009 \{s Vides °° bai 49 a a owl rth. “wk 
ae Pag |) 
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\ Tr(A,A,) = 0 (1.9) 


Did: 2 
but now Tr(A,-A,) = Tr(A,A,) = Tr(A.ACA, 
(AA, (AYAG) = Te(A,AsA,) 


HAE cage? a 


From this in view of (1.9) we conclude 


Tas =0 «for all a4 Fed. 
(ii) Since AE = 0. (for-allysis# j,°+werhave 
0 = Tr(A.A,) rete A} = Tr(A a’) Te ACAD) (1.9 a) 
a ae A ele meas bak iy 


Also looking at (1.8) we have 


| | 
> 
eed 
u 
m4 
> 
HN 


Write 


2 2 
Aa =A ae A, - A,) 
1 L ‘ a J 
Since A, are symmetric, we have 


y, Oe we 2 2. 
TECA cA) thdeeky) Tr[(A,-A,) oh (A, ADH 


but because of relations in (1.9a) we get 
7 . 
Tr(A,-A,) (A, -A,) 0 


Therefore, 


wT: oa 
7 = 
oan) 7 ve - 


7 


(*) 


; : 
ip@.t) ; (Apna = (GA, Alaz = - tees tA Aait =o 


es oo, 4 
ahutdnos ow (Chit) to bate mt akicmest 
. sate Ve —y ‘ 
Lt Hinge ee ; 
Bert ow LE Le ae es sone Ey | 


sya sw (BI) te Bits 


6) oath | 
is 
"| 
wy 
» 


4 


Heed ay biel Gi 


ss . 


Ls 
2 
A.A; = 0 for any i (see (*)) 


hence Ci: 


(iii) We have 


a= (Fa)? el at pea oR: 


(iv) In order to prove this, it is sufficient (by virtue 


Ofte Cl) (2d) and’ (aki) (to. prove that aG... © and C imply C 


2 S) 4° 


Since the rank of an idempotent matrix is equal to its 


trace, 


equivalently 


(v) Consider the set of equations Ax = x, Ax = 0, 
Ax=Q.: Ax =x can be written as (A-I)x = 0. Since A is 
m 


idempotent of rank p, there exists orthogonal P such that 


P'AP = and thus P'(A-IL)P= 


Therefore rank (A-L) = rank (P'(A-I)P) = n-p. 


' 
auiriy x4 calstiaiw gl ot , utility Weaquos Fehaet no ; 
. A oe A So aN, aaa (92 ae th 


- 


ai? of Imueb) es afovea s=stogmgbh Be 90 ates iia sobtt: 
7 ‘ 
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Hence the equations Ax = x, A,x = OF Awe HO, A PRRA Sz 1/0 
m 


2 3 


contain at most n-ptp,t...tp = n-P, independent equations, and thus 
have at least Py independent solutions. Thus these equations 

give at least Py independent solutions to A,x =x. By 

writing Ax =x as (A, -I)x = 0 we see that there are exactly Py 
independent solutions x. Now therefore from the characteristic 
equation A,x = x we conclude all the non-zero characteristic values 


1 


of Ay are +l and thus A) is idempotent. Similarly A, is 


idempotent for i= 1,2,...,m. Therefore Cc) follows and hence Cc, 


gives C, by (i) and hence the result follows. 


together with C 9 


3) 


§2.4. The criteria which we discussed in §2.2 were dealing with 
general quadratic forms. If we confine our attention to non- 
negative quadratic forms then the following is an easy criterion 


for testing the independence. 


Theorem 8: (Matern [25]): If two non-negative quadratic forms in 
normally correlated variables with zero means are uncorrelated, then 


the two forms are independent. 


Proof: Let the two forms be 


an y 
S = Bou 
Qy a X Sant 4 : Q9 aS 497473 


where x,'s are normally correlated with mean 0. Write 
cu 


° wating 2? (1.10) 
sila EL ) tose ee Qo = Brae 


a 
ota ee, yy) ¥ 


(iss petiaee efow C8 ck Neneh Oat te Ge 0 
toy Os WALT HEI Se stu antingdedu ST ae 


nofztsit2>: (eka Me. et wie os > ait 
ya rae i 


nb gorvot olinrbayp avi 28gon-nen OMe Shy 20085) fe 
moda ,betelatavsgy S16 evad) Gisé : 


1 


where y,'s and z's are linear functions of x,'s (see §2.3), 
and all Cy and a) are positive. Ignoring the subscripts i and 
. 2 2 ; : 

j, let us suppose we and oF denote respectively the variances 


of y and z, then we show that 
cov (y,zZ) = 0 => cov Eo) = 257 


For 


ys aes 
Cov (y 52’) Boece ~ once 


f f eee Cede - o. aac 


= f ii ebay acon ta ei yer ~ 0 


ho 


2 
oO 
2 ae y 2 2 2 
f Zz Te Rone Ce: Vue 2 zden oy oF 
Zz 


(p = correlation (y,z)) 


2 
0 
2m 2 Zany & 
re uae, 
0 
Z 


I 
Q 
< N 
va 
ir 
7S) 

i) 
YY 
Q 
N 
! 
Q 
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Therefore 


CONC AO) ak pane 
AS = 


Ald cc. “andi ee bedtiz posi tive mthereionre 
1 J 


oe | 


ee ay can | 
Lee aye in “i aoe to oe nectil » 
7 Mar ; Sam t eigbroewue, ait oabronnt ‘hs 


- - sesanbnwy aia iad so 


» a 


fe - sion Ce 3 eeu = 
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Cov (Q, »Q,) = 0), =m>.i0..4=.0 


i.e., Qa and Q, are independent. / 


Also from Section 2.3 we known that if on = X'AX and 


Q, = X'BX where X is N(0,V), then 


Cov (Q, 22.) = 2 tr (AVBV) 


Thus in the case of independent normal variates with 


mean zero and unit variance, Matern's result gives 


tr (AB) = 0. 
But 
ee Ginyeserred Oone! “ae! celae, 
oF 
Pe ae oe oes ae 


Hence 


Be Ns Cet sd 


AB 0) 


Thus, obviously it follows that Matern's result 


(Theorem 8) for the case V=I1 is equivalent to Craig's result. 
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Y. Kawada [17] generalised Matern's result (Theorem 8) to the 
case of arbitrary quadratic forms, but only when the variance - 


covariance matrix V = I. We now give Kawada's generalization. 


Theorem 9: If two quadratic forms 


n n 
als a, .X.X. , = ) WE Os F @Usi2) 
boven jai 41+ J eisai ei 


in normally correlated variables Xp oXy ores eX, with zero means and 


variance ~ covariance matrix V =I satisfy the following conditions 


ms Lilja d)n(oj) = es ue 
Fi, 7 E(Q,Q5) - E(Q))E(Q5) = 0 , 4595 1,2 elyiey) 


then the relation 


holds. 

Before we outline the proof of this, we note the following 
simple but nonetheless important consequences. 

(I) When Q, and Q, are non-negative then Theorem 8 
(Matern's result) follows from Theorem 9 by taking i=1, j=1 


in@Clsl3). "For, then, Foy = Cov (Q, 2Q5)3 but 


Cov (Q) 295) = 2 Tr(AB) 


i] 
S) 


Tr (AB) ==> AB = 0 


CLI) LE Qi» Q, in (1812) satisfy four conditions in (1.13) 


then Q, and Q, are independent. This follows because AB = 0 


7 7) 
" a. io a 


aaheded ee ae 


7, 
=. | 
a hh sammie — tind 
a seins) evekmwa avg 
7 -_ 7s _ 
_ Pe 7 
7 -_ 
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: 7 es) : : — a 
hea We ‘ue Lidl eis! yisives , = Vo x2adea wots vos “9 b 
7 ro — a 
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noksel ox as 
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_.. 
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implies independence. (Sufficiency of Craig's Theorem). 


(III) The necessity part of Craig's theorem follows from 
Theorem 9, Le errye LE Qa and Q, are independent then AB = QO. 
It is quite clear that the independence of QQ and Q, implies 


(1.13) and hence AB = 0. 


Proof of Theorem 9. 
It can easily be shown that the first eight moments of 
i ; 2 
x, kad. th) | are E(x, ) Sse oad ete ea ey E(x, ) —Jopie 
= 3, B(xp) = 15, B(x) = 105. Using these values and by a 


straightforward calculation we have 


(1) Fj, = 2 Tr(aB) 
(2) Fi, = 8 Tr(AB-) + 4 Tr(AB) Tr(B) 
(3) F,, = 8 Tr(BA’) + 4 Tr(AB)Tr(A) 
22 2 2 
(4) Foo = 32 Tr(A B ) + 16 Tr[(AB) ] + 16 Tr(AB )Tr(A) 


+ 16 Tr(A°B) Tr(B) + 8 Tr(AB) Tr(A) Tr(B) 


+ B[Tr( AB)” 


(1) follows immediately from (1.7); (2) and (3) are 
symmetrical. For the sake of illustration, we outline here the proof 
Ofte C2 

F,, = E(Q,-Q5) - E(Q,)E(Q5) 
12 122 a 2 


On diagonalizing, 


‘ ‘ Zz 
B(Q,°Q) = BL) ay 1 B47) 
1 »J 


(fs / 2 
rns Aw ao On 1 0 mn? 
m,n 


~3 none 


it <(ap8 J ee.rt=it 


4 ¥¢ bes eerie seo? erie 


| C4 )2T (8A), A & BAIA 8 * of (5) 
(Absa ahaa? 6+ aay? SA ie ey. _ 
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i] 
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¢ 12 ¢ ‘ Ud 7} 12 
+ } 12d ,b5, + Py tabhb + Za pe 


2 2 
= 8 TR(AB-)+4Tr (AB) Tr(B)+2Tr ATrB +(TrB) TrA (1.14) 
because 


Tr(A) 


il 
Te! 
poe 


i} 
mi 
Oo. 


Tr(B) 


Tr(B°) 


Ii 
ll et | 
ui. t-1 
o~ 
ins) 


i} 
Mm 
>. 


Tr (AB) 
and 


Tr( AB“) = ) a.b 


Now it is easy to show that 


(ai, 5) 
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2 
E(Q,)E(Q,) = 2TrA:TrB’ + (TrB)tra es) 
Hence (1.14) and (1.15) together give 


Fi > 8Tr(AB“) + 4Tr(AB)Tr(B) 


Equating (1), (2), (3) and (4) to zero and simplifying we have 
2Tr(A°B’) + Tr[(AB)“] =0 . (1.16) 
Write C= AB, then (1.16) becomes 
2Tr(cc') + Tr[c*] =0 . (1.17) 


ie C.= (c, 4), Cis = 2. ahs Then (1.17) can be written 


n 
Se Gas cal) hon 4 (1.18) 
j 


in 16.6) ast oie . > O, the corresponding term of the 


summation is positive, 


’ 2 2 
df oe my write Coe an as 


mG - c..c,, which is positive (being sum of two positive 
aja! aah jee 
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In (1) above we looked at the case when A, B_ were both 
non-negative. If however only A is non-negative then Fi = 0 and 


Fo = Q"together {imply AB = "0. 


Theorem 10: In the context of Theorem 9, let A be non-negative; 


then Fi = 0 and Fio = 0 imply AB=0. 
Proof: On solving Fi = 0 and Foo = 0 we have Tr(AB‘) = 0. 
Since A is non-negative, we can choose a real symmetric matrix A, 
such that A = << let C =A B, then Tr(AB-) = Tr(CeC') = 0. 

O fe) fe) ‘aie, 

But 
- pati 
") = = = = 
20x (UG) = 0 ipl (ey te,,) = 0 (C (cy ,)) 


Therefore, 


i 
(S) 


C = 0 or equivalently AB 


Hence RE =ACCK By) = 0 ey. 
Oo (@) 


Now let us suppose that Q4 2% 22 2Q are m_ real 


symmetric non-negative (or non-positive) quadratic forms. Write 


If Q is any other quadratic form (or linear form) then B.R. Bhat 
[3] investigates independence of Q and Q'. In the following theorem 
we shall give a criterionfor the independence of Q and Q' for 

m= 2, this theorem can easily be extended to the case of any 


finite m. 


>... riba i oY 
ee er stad Part? 
5 ca cart 


Ui ries | 


ie - a a 
Ws -_  pebrayee-? noc ad a pat id ane aol ial ou naxoat 
! _ 
: 7 0 = uh. Nena a= oe “i 
: a 


0 = cd Sen yur sveise 0 =, gj dan) | fh = eel ia. 
of it dae sae Taste sengity ne aw sla 


7 . wr, 


_ , 
& yy 9)" ) = SY teats ta " 1% fo - Co a)ats 7 : 


0 = ah iiaastav lupe #5 oO #5 
. 7 
7 


\e De (2), hy A * BA 


lesr a rd) asnighpe So aaa 
s2ioW rou aacrimun (#itAbaca=non a0¥ 


i= 7 
taetboy 
* 


24 


-Theorem 11: If QQ, and Q, are two real symmetric non-negative 
(or non-positive) quadratic forms, then a quadratic form OP eis 
distributed independently of Q, 72, ip and only 16 it 1sedistri buted 


independently of Q, and of Q,- (X v N(y,V).) 


Proof: (Necessity): Let Qa = X'AX, Q, = X'A,X and Q = X'BX. 


Suppose Q is distributed independently of Q,7Q,- There- 


fore 

(A, tA, ) VB =O , (1.19) 
where V is variance covariance. matrix of xX and 

' = 
x Gia, ae 

Write VB as D, therefore 

1 + = 

L(A, A,)D 0 2 (1.20) 


where Ly is any n-dimension column vector. 


It is clear that we can assume without any loss of 
generality that Ay is diagonal. Let Ly be the first column of 


D. Therefore, (1.20) implies 


t = 
L(A, tA, Ly 0 


. ij = ! a 
yo LAL 0 and LAL, 0 
Ce A, and A, are both non-negative or non-positive). 
My ess b 
If we denote Li by (2, ho > ok) and A, y 
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* r = ; e 
Diag (d,.d,5-+++.d_) then LAL, OQ implies 


but all non-zero ds S are positive or negative. 


eo denote n columns of D_ then (1.19) 


implies 


A,L, = 0 => A, L,= 0 


Repeating this process by taking L,,L geveal, we finally get 


273 


and 


Again recalling Theorem 2, we conclude Q is distributed 
independently of QQ and of Q,- 


Sufficiency of the result is obvious as A,VB = 0 and 


A, VB =) Qveclearly impiy (¢lsl9). 
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§2.5. So far we have discussed certain criteria for testing the. 
independence of two quadratic forms. However, our discussion was 
invariably confined to the central normal random variables. In this 
section we shall extend Craig's theorem to the non-central correlated 
case. Finally we shall give an extension of this theorem which is 

due to J. Ogawa [27] when the random sample is taken from a multivariate 
normal distribution. First we give the following extension which is 


due to O. Carpenter [8]. 


Theorem 12: Let X' = (X) »X5 +++ 9X) be a set of normally and 
independently distributed variates with equal variance a and means 


mas = ! = if yt 
u (hy Uy oeee oh). Let Qa (1/2) xX A,X and Q, (1/2)x Ax be real 


symmetric quadratic forms of rank ry and 2) respectively. Then 
a necessary and sufficient condition that QQ and Q be statistically 


independent is that A, 7 Ay = 0. 


2 Pl 
Proofs We assume w..o.g. that o = 1. Let M(t, st.) be the joint 


moment generating function of QQ and Q,5 then 


ul =—1 ~(1/2 
= exp[> u'(t,A,tt,A,) (I-t A, -tyA,) p]|i-tsA,-tA, ( ) 


where ty and ty are restricted to those values for which 


(I-t,A ~t,A,) is positive definite (cf., [15], page 389). 


iL 
We shall show that 


M(t, >t ) = M(t, ,0)°M(O,t ) 
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Assume A_,A, = 0, then clearly (I-t_A ~t,A,) = (I-t,A,)(i-t,A 


149 14 2? 


and therefore, 


(Tet Alt 


vAr-tyAy! = [t-t,4)|- [I-t2A,| ; (427) 


(I-t,A,-tA 


(I-t,)4,) (into 4)) pAyntyAg) 


(I-t,A))+(1-t,A,)-1 


Multiplying on the left by (I-t A) and on the right side by 


Cops) a we have 
: at “) el = 
ce (I-t,A,) +(I-t)A,) -(I-t,A,) (I-t,A,) 


1 it 


-1 = = -l| = 
(I-t,A,) (I-t,A,) -I = (I-t,A,) -I+(1-t,A)) ere 2c ) 
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Using this, (1.22) gives 


-] a -1 = 
(t,A,tt,A,) (1-t A)-tyAo) = t,A, C1 tyA,) +t,A,C tA) 


ORG lao, 


Thus because of (1.21) and (1.23) we immediately conclude 


that 
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a a5 
fa os A 4 
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7 {t,A,(I-t,A)) tt,A,(I-t,A,) sav 
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Since yu is arbitrary, we can expand the exponential terms as 
power series in wu and compare the coefficients. We conclude (from 


comparing the first term of the expansions 


=(1/2)7 2 = 2) 


A, | = [i-t oso 
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a4» ? 
but we have already shown in the proof of Theorem 1 that this 
implies AJA, = 0. / 

Now we shall discuss the statistical independence of two 
quadratic forms in the case of multivariate normal population as 
given by J. Ogawa [27]. 

Consider the k-variate normal population with means 0 


a gh ‘ 


and Var.-Cov.matrix V distributed according to (2m) 
exp[- 5(x'V'r) Jr where r!' = (r),%55--+,t,)3 dr = dr),dr,,...,dr,: 


then 


Theorem 13: Let X' = (X, Xy0+++5X)) be a random sample of size 
n from a k-variate normal population. Then the quadratic forms 


a- X'AX and OW a X'BX aré independent in the statistical 


sense if and only if 
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AVB = 0; V = VxI (Kronecker product) 


holds for coefficient matrices A and B; where V is covariance 


matrix of normal population. 


Outline of Proof: (for details cf., Ogawa [27], p. 99): Considering 
X as a vector of nk-dimension, the moment generating function of Q, 


is given by: 


mri De Cal 2 
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and since va is positive definite all de are positive. 
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P = PxI (Kronecker product; cf., [28], p. 29). The 


Jacobian of this transformation is 


, BOR 
0(x*) 


Integral (1.24) reduces to 


|det B| = |det P|" = 1. 


Mite) = (2m? [yl ff o,f exp (- A cxetixey 


— 2t(X*'P'X*) }} dr#... drs 


where D = DxI. 


If we make another transformation 


Y = xxQ 
where 0 = QxI and 
is 0 
= iS 
Q do 
0 Vr 


the Jacobian of this transformation is 


a (Gi) 2 
| 2GE) | = fact EH] = fact vj" = 


Consequently (1.25) becomes 
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_\-(nk/2 
M(t) = (2m) Eyal. mae we 
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ae A “A Pha 
zexp ty *y-2(Q y? PP" APyO ae dy , 
and this gives 


hia |r-2tax| ~61/2) 


where A* = gq tptapq } 


Similarly the moment generating function of Q, is 


M(t) = |t-2eB%|~“/? 
where B* = pea BR One 


Then Q, and Q, are independent iff 
A*B* = 0 
Gon. (0 merc MEN OL... (1.26) 
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CHAPTER III 


DISTRIBUTION OF QUADRATIC FORMS 


§3.1. In the previous chapter, we talked about the independence of 
two quadratic forms in normal variates along with various other related 
results. Basic and indeed the most practical theorem of that chapter 
was the one due to Craig. In the present chapter we shall go one 
step further in the distribution theory of quadratic forms and shall 
discuss various conditions under which a given quadratic form in 
normal random variables follows a (aie epin att on Among various 
results to follow, our attention will mainly be focused on Cochran's 
theorem (Theorem 15)and various generalizations of it. 
Theorem 15 is.due to W.G. Cochran [5]. Earlier R.A. Fisher 
({10], pages 96-98) proved another theorem of this type; and because 
of this similarity, Cochran's theorem is often referred to as Fisher- 
Cochran theorem in the literature. Apart from the original proof 
due to W.G. Cochran [5], J. Ogawa [27] has also given proof of 
this theorem which is based on a series of algebraic lemmas. 
G.W. Madow [23] gives the algebraic basis of Cochran's theorem and 
uses it to extend Cochran's theorem to the non-central case. Later 
G.S. James [16] pointed out by proving three theorems that we do 
not need all the hypothesis of Cochran's theorem for its validity. 
A.G. Franklin and G. Marsaglia [9] have extended Cochran's 
theorem to the correlated cases and their proof has subsequently 
been simplified by K.S. Banerjee [4] and R.M. Loynes [22]. These 


results involve the notion of idempotency of matrices. A.T. Craig 
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[7] has given a necessary and sufficient condition for two quadratic 
forms to be independently distributed as eo here also the 
idempotency of the matrix is involved. 
If Ca pao follows a multivariate normal dis- 
tribution, what are the conditions under which the quadratic form 
Q = X'AX follows a eedle rei bation? This question has been dis- 
cussed by various statisticians viz. B.R. Bhat [3], D.N. Shanbhag [32], 
[53)sandi.J- 9 Good [12] “Later G,PsH-=Styan. 131 |)specializes this 
question and discusses separately the conditions under which Q 
follows central and non-central ied erbuedon and finally he gives 
a generalization of Cochran's theorem. Also in this paper he points 
out a mistake in I.J. Good's [12] result by giving a counter example. 
Finally we remark that G.W. Madow [8] has given various 
generalizations of Cochran's theorem which are applicable in the 
Multivariate Statistical Analysis (cf., Theorems 7, 8 and 9 in 
[24]). The derivations of these generalizations depend upon other 


theorems proved in the paper, 


§3.2. Let Xp oXoore sok, be normally and independently distributed 
with mean zero and variance 1. Consider the quadratic form 
Q = X'AX, where X' = (5 »X5 000+ 9%) and rank of A= pr. On 


writing 


where Dr, are the non-zero eigenvalues of A (cf., §2.3) we 


immediately have the following. 
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Theorem 14: If XoXo are eK, are normally and independently distributed 
with mean zero and variance 1. Then the quadratic form Q = X'AX is 


distributed as is the linear form 


where - a are independent and follow odiserioution With ol) dato: 


and Me are non-zero eigen-values of A. 


Corollary 1: Under the hypothesis of Theorem 14, a necessary and 
sufficient condition that Q = X'AX follows a yee ateerabubion is 
that the non-zero eigenvalues of A are all l. 

The following theorem,which is the central theorem of the 


present chapter, was published in 1934 by W.G. Cochran [5]. 


Theorem 15: (Cochran): Let XoXo ore eX be normally and independently 
distributed with mean O and variance 1; let Vyodose ee ody be k 
quadratic forms in x, 's With dF Ny oMos+++ ony respectively and 


such that 
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nase 


1 TL respectively is 


gore 


ny + n, AS Bete oe ie 2) 


a 
‘Se bagels pseu ban ui ny - a gal 


qi XA'X =) wt oiterbsut ads nett “a ootetanvy sae 5 


- _ 


=102 eet ofa et “= wd :- 


. : : 7 
-+.b 2 déyte cvdgndiaielth~ x wollot bas iwehnaqstat sie Me 


- ; 
A 24 Geifav-negis orss-o0n 936 , 


eg veemegoon w Al ieatoodT to “ebasdtagyn *) vob 1 gyebigro3 
. —— 

a - > 

acta breelhe ye avelic? SAK =f Get) cottage tnadod hve 


fo ite 2m A to eanflavesgty erse-nor aul ind? : 


any io meThed) LaPFINSS allt 2. a iieeiancnds gnivolioy sant ez 

te} waGew 2b. 4 SBOL wh parEetiavy aay 290gss suseerg 7 

7 mY 
yiinebasgsbni bea citparreu av eT tas $u2 aes aa 7 

qT od geese reuPeyh? ) oe ed bee 0 ot dotw. tatu a 7 7 

bi Viwvisosqess phaib or vq ltngl “nb. WIdw et a! amb od 


saris Howe 


¥y & a 
ET fda ae Ge 4 pia 
7 | i a ) — 
or. ta. 
greonegty? wid nets hice: suo 3 fe Hin acatcls &, walt = 


Sab eal anarsude aan ol acaaiilad punt : bord 


39 


Earlier R.A. Fisher [10] obtained a similar result which 
can be stated as: "If Xp oXooreeoX, have independent standard 
normal distributions and if ZjsZoo+++2, are h (he< nn) Yorthonermal 


linear forms in the x, 'S, then the quantity 


is distributed independently of ZjoZoo+++9%, as ¥ with (n-h) 
degrees of freedom." 

Apart from the original proof of Theorem 15, given by 
W.G. Cochran [5], J. Ogawa [27] has given an algebraic proof, which 
depends on various algebraic lemmas. Both the proofs have been 
combined and modified here to prove this theorem by an application 
of Theorem 7. 
Proof of Theorem 15: (Necessary Part): If Vp oIg sree ody are 
independently distributed as ye dar cibucions Wat! daw, My sMyo+++ My 
respectively, then q,t4,t-- td, is distributed as a Vo dtetetbuelon 
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(Sufficient Part): Let Ay rAgar sss AL denote the real symmetric 
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then condition (3.1) in terms of matrices can be written as 


A, + A, are ated 2c AL. = I (333) 


where I is the identity matrix. 

Now we see that Part (vy) of Theorem 7 implies 

(i) A, =A, , 1 SS ek ls 

Cit) es =O, LP ee ee, are re 

Therefore Craig's theorem (Theorem 1) implies the indepen- 
dence of quadratic forms; and idempotency of the matrices implies 


that they follow een cn (Corollary 1; Theorem 14)./ 


A simple application of Theorem 15 gives us the following: 
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A = (a, 5)» we shall show that 
r(A) + r(I-A) =n 


Then, the assertion of the corollary is an immediate consequence of 


Theorem 15. 
Since Q_ follows ve distribution, the non-zero 


eigenvalues of A are all 1 (Corollary 1). Therefore 


where y are new variates obtained by applying an orthogonal 


transformation T_ such that 
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G.S. James [16] has also discussed this theorem, and he 
has pointed out some redundancies in the original statement of 
Cochran's theorem. He has claimed that we need only assume (in 
Theorem 15) that dp ogee esd have Co dieeriberten or that they 
have independent distributions; the other property and also the fact 


that 


then follow. 
More precisely James [16] states and proves the following 
three theorems. 


Suppose xX, ,x 


1 ook have independent standard normal 
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distributions and dy odgetees are quadratic forms in the x, 'S of 


Ik 


ranks Ny oN o+++ ML respectively satisfying 


Then: 


Theorem 16: If i} a, =n, then each q, isa a variate with 


n, degrees of freedom, and the q, are distributed independently. 


2 , ; 
Theorem 17: If each q, is a x -variate, then q, are distributed 


independently with a d.f. and ) ee = ie 
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Theorem 18: If q, are distributed independently, then each q, is 
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We notice that Theorem 16 is the sufficiency part of Cochran's 
theorem, whereas Theorem 17 and Theorem 18 both state differently the 
necessary part of Cochran's theorem. Here we shall give the proof of 
these three theorems and consequently we shall have another proof of 


Cochran's theorem. 


Proof of Theorem 16: Since qq has rank am), we can find an 


orthonomal transformation of the x. to new variates ba: such 


elneye 
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Thus qd is a positive semi-definite form distributed as a with 
ny degrees of freedom, independently of dota,t...td,. Similarly 
every q, is a positive semi-definite form distributed as ie with 


ce d.f.; independently of 


qd) + q> 1g Ai agate rie Gruen + 


jal ae eer ay 


Now, it is easy to see this implies complete independence 


of q,'S. Y 


Proof of Theorem 17: 


Since qd is a quadratic form of rank nj,» we can find 


an orthonormal transformation to new variates ba such that 


2 
q, = 4,8 tee + E Or 


fon 12” 


ee 
2 n, # 0) 


Since the oy are independent standard normal variates, it 


follows that the moment generating function of qi is 


-(1/2 
Migs e240), eos te) ee 
on 1 
2 ~(1/2)v, 
But q, is a x -variate, so that Mo is of the form (1-2t) ‘ 
1 
where Vi is the number of degrees of freedom of qi: 
Identifying these two experessions for oa we have 
ul 
= = = =) = 1] 3 
vi mn, and ST ho a 
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Hence qd, is distributed independently of qd, “ihe a qd and the 


same is true of other see 

Therefore we conclude (see Proof of Theorem 16) that the 
q, are mutually independent eo Syariates with he degrees of freedom. 
Thus ) q, is distributed as ve with ) ey degrees of freedom; 
but ) q, = xf is also distributed as with n degrees of 


freedom. Therefore ) A =n. / 
j 


Proof of Theorem 18: 


Since qy is a quadratic form of rank n,> there exists an 


orthonormal transformation to new variates bas such that 


2 2 2 2 
Gop. te eo. te CloAs 1a na 


a 


Therefore the joint moment generating function of qy and qot---+4,5 


being the expected value of exp [q,tt(q,+..-t+a,)ul], is 


M (t,u) =[{1-2,t-2(1-),)u} 
Godot +t, AL. il 
n-n, -(1/2) 
.. {1-2 t-2(1-A_ )u}{1-2u} ] 
al My 


(Gia) 


But qd and qot---td, are distributed independently; therefore 


ee eer ee +q, ©) (3.10) 
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Comparing (3.9) and (3.10) we have 


{1+2_tt+m.u}...{1+2 ttm ul} 
il JL ny n, 


= TS ae eae ree Saree (Snd4) 


where 


&, = (-2,) and m, = (-2) (1-A,) 


For fixed u, comparing the coefficients of highest powers of t 


on both sides of (3.11), we conclude 


identically in u. 


Therefore, we get 


m, = m, = Ta = 0 
ae ST = ho = = ro = 1 
1 
Somenlat 
Y 2 2 2 
= : ace ck = + ose6. + 
qy 1 Stee age) ete "ae q5 a co ntl En 


and now the rest of the proof follows on the same lines as in 
ineorem L/.7 7) 
We shall prove the following Theorem 19 later in the section, 


but for present, we are just stating it to get 


Theorem 20. 
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Theorem 19: "ft W ie"disitributed as N(u,tI), then a necessary and 

sufficient condition that Y'AY is distributed as yee 

(where i = > uty is that A be an idempotent matrix of rank k. 
Using Theorems 7 and 19 together with the following result 


(which is an extension of Craig's result) we get Theorem 20. 


"If Y is distributed as N(u,t), then a necessary 


and sufficient condition that Y'B,Y,Y'BAY,+..,Y'B 


independent is that ere. =O. efor ail lyn tioee: by ce 


ma be jointly 


Theorem 20: If Y is distributed as N(u, 1) andait 


where the rank of A equals p and the rank of A. equals Pi > 
then 


(1) Any two of three conditions C,> Cy. C, are necessary 


and sufficient for all the remaining conditions; 


(2) Any two of the three conditions Di» Dy» D, are 


necessary and sufficient for all the remaining conditions; 


(3) Any two conditions C, and ee i#j are necessary 
and sufficient for all the remaining conditions; 


(4) Ey and C, are necessary and sufficient for all the 


remaining conditons; 


(5) EL and D, are necessary and sufficient for all the 


remaining conditions , 
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C, : YAY is distributed as Xie) where 


Ay = (uA, yu) /2 for t=) eee ee Kk. 
(oe YAY and a are independent for all i # j. 


C,: Y'AY dis distributed as TENS where 


AS MCu Aq) /2. 
Dea Each A, is an idempotent matrix. 
Dix AA. =s Opetor al] yds Fe 


D,: A is an idempotent matrix. 


In the light of the preceeding remark, proof of this theorem 
is immediate; moreover if in the above Theorems 19 and 20 we have Y 
distributed as N(u,oL), then again all these results are valid 
except each quadratic form and each A and ds must be divided 
by oo 

Now we are in a position to give the generalizations of 


Cochran's theorem (Theorem 15). G.W. Madow [23] has extended 


Cochran's theorem to non-central case as follows. 


Theorem 21: If \Y is distributed as N(u,1) and if 


(where rank of A is n,)> then a necessary and sufficient condition 


ni 


that Y'A,Y (i = 1,2,...,k) are independently distributed as 


matoun? @b, I0 Joorg aaacniaa 


Y  s¥q2@ su 0S bea, SE me20: 
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2 k 
x! (n,, a eethate a eee on 
i , 5 
i=] 
We shall deduce this theorem from Theorem 22 which 
appeared in [9], however for an independent proof of a little 


more general version of Theorem 21, readers are referred to Cl23ie 


pages 102-103). 


Theorem 22: If Y is distributed as N(u,V) where vV is nxn 
positive definite symmetric matrix, and if 
k 


YiBY = ) MIB UY 
i=1 


then any one of the six conditions, Ci> Co» Cy; Cys Ce Ce is 


necessary and sufficient for Y'BLY to be independently distributed 


Ms is 
Te ee (P,A,) where Oe edy u'Bi ue 


k 
C,: BV is idempotent and ) ye ae 


C.: “BV seand)each BV be idempotent. 


2 
C.: BV be idempotent and eel =O .for ol) (4) + i. 
2 k 
C,: Y'BY be distributed as §iXC’ (oY) yand ) p= ) P;- 
i=l 
ere 
OSS i u'Bu).- 
° ° 2 
C.: Y'BY be distributed as x" (p,A) and BV be 
1 
idempotent, (where 4 ae u' By) 


2 
Ces, -Y"BY | be distributed as ¥' (p..)° sand Peas = O° hor 
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i# j where A =o, u' Bu. 
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Proof: Since V is positive definite, there exists a non-singular 


matrix P such that P'VP = ie (see [28], page 36). Let Z= P'y; 


then Z is distributed as N (P'u,I). Also Y'BY = z'p tppr ly 
VIBAYe= z'p tp pt ty, and 
1 ale 
-1,.,-1 é ~1 -1 
Zu (2) BPR! ga) Zux p) enZ' (Bay Phaze - (3.14) 
i=l 
=i = = = 
TE wenlet A = Pacep*s © and A= P "BP" a then (3.14) 
can be written as 
k 
ZUAZe= yy): Z'A,Z 
i= 1 


Now our theorem follows immediately (indeed remarkably!) 
from Theorem 20, if we show that BV is idempotent if and only if 
A is idempotent, BLV is idempotent if and only if A, is 
idempotent and ey =) Otstore® tof tie) al 6 RA PuQurtiors As 7) 7. 

We prove this. 


A idempotent iff A‘A=A 
iii (P ape) (ee BRlan) = (pt ppt) 
tee Epi pp San 
iff BVB = B (Sees Paes ay 


iff (BV) (BV) = (BV) 


Similarly A, is idempotent iff BV is idempotent. 


; sul -1 
Now Bee = 0 for i { implies _P ys = 0, 
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Bio yenien yee pani for i # 4 
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Also the reverse implications hold and thus the theorem is established. / 
Taking B=I1I and V=I1 in the above theorem, we see 
that Theorem 21 falls out right away. Taking k= 1 in the above 


theorem, we have: 


Corollary: If Y is distributed as N(y,v), where V is nxn 
positive definite symmetric matrix, then a necessary and sufficient 
condition that Y'AY be distributed as et where p is rank 
of A and where XX - + u'Ay is that AV be idempotent. 

Now we go to another result due to A.T. Craig [7] (Theorem 23) 
which affords a simple test as to whether the distributions are of 
“BE type. Finally we shall conclude this section by giving proof of 


Theorem 19, a generalization of Craig's result (Theorem 23). 


Theorem 23: Let Q, = X'AX and Q, = X'BX be two quadratic forms 
in n normally and independently distributed variables with mean 
zero and variance one. Then QQ and Q, have independent chi-square 


distributions if and only if 


2 
EO ee aa carder ee 


A very simple and straightforward proof of this theorem is 
given in ({7], pages 196-197). 


We now conclude this section by proving Theorem 19. 


Proof of Theorem 19: We shall first prove the sufficiency. Since 
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A is idempotent of rank k, there exists an orthogonal matrix 


Such that 


is distributed as N(a,I_) where 


and where Z, and ay are both k x 1 vectors. Z, is 


distributed as N(a, 51, ). Also 


Therefore it follows (see [9], Theorem F, p. 679). 


ig 


Y'AY = 2524 is distributed as YT atk.) where A = 5 Oy 


Thus our result will follow if we show that 14 Oy = p' An. 


Write P= (P| »P.) where P. is nx k. Then 
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(Necessity): Let us now assume that Y'AY is distributed as 91 Ce) 
and we shall show that this implies A is idempotent of rank k. 

Let C be the orthogonal matrix such that C'AC =D, where D is 

a diagonal matrix and number of non-zero diagonal elements dss is 


equal to the rank of A. Let Z=C'Y then 


nN 
Y'AY = Z'C'ACZ = z'DZ = J d,.2° 
Tl abak al 


2 
Again since Z is distributed as N(C'y 1), Zs is 


2 
distributed as ace) where ds = [E(z,)] /2 (see [9], 
Theorem F, page 679). 


Since the z, are independent, the moment generating 


function of ) wee is 
3 = is ae 
i=l 
et Glee Nene 
-(1/2) Ln ed Sipe 


as 


(I=2td,,) 


2 
Also, since Y'AY is distributed as y' (k,\), the moment generat- 


ing function (see [21], page 49) of Y'AY is 


ad 
-k/2  -Ati\(1-2t 
(1-2t) / e ( ) 
° 2 
Since Y'AY = ) d,.Z,, these two moment generating functions are 
j=) Ui 
equal and we have 
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Both sides of above as functions of t are analytic for some 
neighborhood of zero. For both sides to have the same singularities 


we must have k of diy as 1, n-k of di; as zero and 


Thus if Y'AY is distributed as Ce oe then k of 
di. are equal to unity and n-k of dis are equal to zero. But 


di. are the characteristic roots of A. Hence A _ must be 


idempotent of rank k./ 


§3.4. Let us consider now the quadratic form Q = X'AX, where 

X' = (X) Xp 00+ 9X) follows a multivariate normal distribution 

with mean vector y, where y' = (uy Hy ose sot) and variance - 

covariance matrix V. Various results have been stated for Q to 

follow a chi-square distribution. B.R. Bhat [3] works with V_ as 

Ue rer ee Teche sGood: fil2]. DIN. Shanbhags[32)59 [33] and 

G.P.H. Styan [31] disccuses those results even when V is singular. 
To prove Theorem 24, we start with the following lemmas. 

This theorem has quite a few applications in the analysis of 


variance as we shall see in the next chapter. 


Lemma 1: A real symmetric quadratic form X'AX is distributed as 


-1 
aC ifeand only Li, A = V ©. 


2 : , ; 
Proof: We know (see [8], page 457), X'AX has xy -distribution if 


and only if 
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Further it has n-degrees of freedom if and only if A is 


non-singular. Therefore (3.15) implies 


Lemma 2: A necessary and sufficient condition that X'AX has 


2 
a cx-distribution (c 3 OP is that 
cA = A:V°A 


Proof: Write X= vc Y . Therefore X'AX has a Peediecetburtcn 
A : 2 
if and only if cY'AY has a cy or equivalently if and only if 


2 
YAY Stas val yas edtstribution. 


Since variance - covariance matrix of Y is 2 Wes 


i 
Cc 
therefore, as in Lemma 1,Y'AY has a chi-square distribution if and 


only LE 
>A or cA = AVA ./ 


I.J. Good [12] has given certain necessary and sufficient 
conditions for a quadratic form X'AX to follow chi-square dis- 
tribution with k-degrees of freedom, where X is assumed to have 
multinormal distribution with mean O and variance - covariance 
matrix V, possibly singular. His conditions depend on the follow- 


ing theorem. 


Theorem 25: A necessary and sufficient condition for X'AX to 
follow a chi-square distribution with k-degrees of freedom is that 


AV (V may be singular) has k unit characteristic roots, the 


resie Zero. 
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The proof is immediate (see [12], page 215). 

Good has claimed if AV has k wumit characteristic roots 
and the rest zero, then AV must be idempotent. Assuming the truth 
of this assertion he gives two results, Corollary (i) and (ii) in eo iz 
Unfortunately his claim igs shown to be false by C.G. Khatri [19] and 


G.P.H. Styan [31]. Here is a counter-example from [31]. 


Let 
2° aie Uae @O 
A= |-1 O. 0 A Veso Nee Les 0 
0 Oat OnerOs Sh 


Here AV has one unit characteristic root and two zero characteristic 


roots, and is not idempotent, for 


1 ik 0 0 (@) (@) 
idee | ected ies Dal He Ge use| 0 Eo ewo 
0 0 1 0 0 il 


In Theorem 26 below, C.G. Khatri [19] has given a necessary 
and sufficient condition for a quadratic form X'AX to follow a o 
distribution, where X has a multivariate normal distribution with 
zero mean. Later D.N. Shanbhag [32] has shown in Theorem 27 that the 
condition stated in Theorem 26 is equivalent to conditions given 


in Theorem 27. We shall prove both of these theorems 


simultaneously. 


Theorem 26: A set of necessary and sufficient conditions for X'AX 


to follow Paiste bution with k degrees of freedom is 
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VAVAV = VAV ; r(VAV) = tr(AV) =k . (3216) 
where V is covariance matrix of X, not necessarily non-singular. 


Theorem 27: Following are two sets of conditions each of which is 


equivalent to (3.16) 
Cig 6Av a= BGA Way eer Cee 


(44) tr{(Av)*] = tr(Av) =k; r(VAV) =k. 
To prove these theorems we start with the following lemmas. 


Lemma 3: If C is a non-negative or non-positive symmetric matrix 


and U and W are matrices such that UW is real, then 


r(U'CUW) = r(W'U'CU) = r(CUW) = r(W'U'C) 


Proof: To be specific, let us suppose C is non-negative. We have 
r(U'CUW) < r(CUW) 


Write C =thEy,* E@iayrealmatrix. 


r(U'CUW) = r(U'EE'UW) > r(W'U'EE'UW) = r[(E'UW) '(E'UW) J 


r(E'UW) > r(EE'UW) = r(CUW) 
Therefore we get 
r(U'CUW) = r(CUW) 


All the remaining equalities in the lemma now follow on 


Hotings Cita.¢ Sandan (By <= r(B'), B any matrix. 
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Lemma 4: If C is a non-negative or non-positive symmetric matrix, 
and if U and W are matrices such that UW is real, then 
U'CUW = 0 if and only if CUW = 0. 


This is an immediate consequence of Lemma 3. 


Proof of Theorems 26 and 27: Let T be a real matrix such that 
TT' = V;_ then it can be shown (cf., [28], page 188) that X'AX 
follows chi-square distribution with k degrees of freedom if and 
only if T'AT is idempotent of rank k. On diagonalizing T'AT we 


can see X'AX follows chi-square distribution if and only if 
D =D and r(D) = k CSeign 


where D is diagonal matrix of characteristic roots of T'AT. Let 


L be the orthogonal matrix such that 
L'T'ATL = D 
If D is idempotent, 


r(D) = tr(D) = tr(L'T'ATL) = tr(LL'T'AT) 


= tr(T'AT) = tr(ATT') = tr(AV) 
$e; lo = EE CIVAT) = te CAV) os 
therefore (3.17) is equivalent to 
TIAT(T'AT-L) = 0, tr(A'AT) = tr(AV) =k . (3.18) 


Writing wea), C= 7k" andy Wo= AT(T'AT-I), T'AT(T'AT-I) = 0 


becomes CUW= 0, therefore Lemma 4 implies that (3.18) is 
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equivalent to 
TT'AT(T'AT-I) = 0 and tr(AV) =k 


TCs, (TT'A-I)TT'AT = 0 and tr(AV) =k . (3°19) 


Now (TT'A-I)TT'AT = 0 is of the form W'U'C = 0 where 
Wie (TEA-T)TT'A, U7 “and C= 1. 
therefore Lemma 4 implies (3.19) is equivalent to 
CIUTA=L) TT ATT! -=.0 and tr(AV) = k 
Loew. (VA-1I) VAV = 0 and tr(AV) = k 


Hence X'AX follows eodietricner on with k-degrees of freedom if 


and only if 
VA(VAV-V) = 0 and tr(CAV) =k. (3520) 


Writing C=V, U=A, W = (VAV-V) and applying Lemma 4; (3.20) 


is equivalent to 
AVA(VAV-V) = 0 and tr(AV) = k (A = A‘) 


en = C-  and “ex(Av)i=-&. 


Tf G17) Rolds, we get 
eens) = tr(D) and r@) =k... Gee) 


Writing C=1, U=T' and W= AT, we see that T'AT has the form 


CUW. Therefore Lemma 3 implies 
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rCIeAt) = eT AT). 


Also TT'AT has the form W'U'C with C=I1, U=T' and 
W' == Trl A. 


Therefore r(TT'AT) = r(TT'ATT'). Hence 


r(D) = r(T'AT) = r(TT'ATT') = r(VAV) 


Therefore (3.21) becomes 


i} 
m= 
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Thus we see (3.17) is equivalent to 
ev[(AV)-] = tr(AV) =k and r(VAV) =k . 22) 


To establish the equivalence between (ii) Theorem 27 and 
(3.16) we must now prove (3.21) implies (3.17) and this will complete 


the proof. 


Lit d, denotes the Mee diagonal element of D_ then 


(3.17) implies 


ives, ) (4,-1)" = oo ender. (2723) 
i 


Also we have Y (a,-1)* > n-r(D) where the equality sign holds 
al 


if «andsonlywif “non=zero d. equals unity. Hence this give (3.17) 
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and we are done. / 


Another criteria given by C.P.H. Styan [31] is as follows. 
Theorem 28: A necessary and sufficient condition for X'AX to 
2 
follow yx distribution with k degrees of freedom is 


Ta eee 


if and only if  r(AV) = tr(AV) 


k or r(AV) = r(VAV) = k (where 
V is covariance matrix of X). 


Proof of this theorem depends on the following lemma. 


Lemma 5: A square matrix S not necessarily symmetric, satisfying 
5? = 53, is idempotent if and only if r(S) = tr(S) or 
r(S) = H(S-). 


For proof of it see ([31], page 568). 


Proof of Theorem 28: 


From Theorem 27, the required necessary and sufficient 


condition is (3.16) which is equivalent to 


(Eee 


Since 


r(VAV) = r(VAVAV) < r((AV)*) < r(VAV) 


By applying Lemma 5 with AV=S, we get the necessary and 
sufficient condition as stated in Theorem 28. / 
We recall, in the above discussion we assumed invariably 


that X has multivariate normal distribution with mean w= 0 and 


covariance matrix V possibly singular. C.G. Khatri [19] 


_ a 


aweiidi mA a [46] me .8.9-2 yd nav te maa iptio 


are 


Ad 


Ma’? 203 ne rat Ber  anet tohliee bar qrasasong a = ita fT 
7 ew [ oo — 
wt gobéay) fo @oetgee ‘gd! tke dnntodbesats * wiisi 


VA ® ty i> 7 
7 


7 7 
esriu) « = (VaV)s = (Wada ste havens = oa a2 dao bn 
: -@ 36 abba Sannlinves as vO 


a [© 7 : 


ores! upkwol 167) O02) m9 ebodyoh we eros ais 36 Teer : 


= 


a 


n= 2) 


ty Shamyve’ ¥ilbuyaseose ton! # ebrtsa ghana, Aa ‘sien 5 an 
: eu Be. 
“go \(2)43 @ (E}e FL viioo Sne Ti TreTOoOmwh- rh ae 2 
ens an 7 
(622 weg @LfO)) eps ii. lo Roots ro 
. 7 7 7 % 


«is at 


ifiyiesiee ,9 


ijathbitive bos vyeRaes. bas tpper siti . 7S oeroadT pa 
— 


- 


oa sraiewiips ef dati cob.6) i 
_ 

ia 

‘ 

» 

aw 


- CVA cain: > st = 


aN 
» SCY = OWA) 
on - 


bik, qreeksuan Suit 339 3m 3 VA % dn 
7 a : : 

\ 38 nia SY uit mr ath a in : 
‘3 ene 
eidetaivad! & ‘bamees ow uo tas a ave do a 1 ‘ 
- 

‘haw i. ue now oie 9 68 ftasabl fon aons te ite 
Oe tt 98 th i 


i. 


A 
silage Gees? 


ian ai aia iy 


: 


58 


and Rayner and Livingstone [21] have treated the non-central case in 


the following theorem. 


We conclude this chapter by stating this result and refer 


the reader to the relevant papers for its proof. 


Theorem 29: A set of necessary and sufficient conditions for X'AX 
to follow a non-central oc distribution with k-degrees of freedom 


and non-centrality parameter d, is 
VAVAV = VAV ; r(VAV) = tr(AV) =k 
u' (AV)? = y'AV 
A = (1/2) u'AVA = (2/2) u"AL 
Applying Lemma 5 to Theorem 29 we obtain 


Theorem 30: A necessary and sufficient condition for X'AX to 


follow a non-central erage) distribution is 
(av)? = AV A =(1/2) w'AVAp = (1/2) p"Au 
PirandeonlLy it 


r(AV) = tr(AV) = k or r(AV) = r(VAV) = k. 


CHAPTER IV 


APPLICATIONS 


As pointed out before, the results discussed in the previous 
chapters have variety of applications in statistics. The complete 
justification of various results in the study of mixed models (see 
[34]), split plot experiments (see [6]) and random effect models 
(see [29]), involves simultaneous applications of results discussed 
in Chapters II and III. Apart from these, quadratic forms and their 
distribution properties have frequent use in ANOVA, Regression Analysis 
and Econometrics, which we illustrate by the following: 
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Lf 2 Let Ky oXoo00+ 9X be n independent normal random variables 


with mean zero and variance 1; then the quadratic forms 


n 
) (eee) and ae 
A if 

d=] 


iz 
are distributed independently as x with n-l and 1 degrees of 


freedom respectively. 


-2 2 
To show this, we observe nx is clearly x with © 


degree of freedom. Therefore, by Corollary 2, Theorem 15 


is distributed as a with (n-1) degrees of freedom and is 


—2 
independent of nx. 
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If. In Chapter II, we talked about the independence of two 
quadratic forms. If instead, we have a quadratic form 4 X'BX and 
a linear form a'X, where X' = {x) sX5o++-sx I, x; being 
normally correlated variables with covariance matrix V, then these 
two forms are independent if and only if the quadratic form 
zt ChE a is independent of 8; 8 arbitrary real variable. 
For, the joint moment generating function of forms a'X and 


1/2 X'BX is given by 


Nile 


al: 


M(a,8) = |I-gBV| exp is moal(UotSeB) 1a} (4.1) 


(ef, a) 5) page 41) 


The first factor of (4.1) involves 8B alone, and is indeed 
the moment generating function M(0,8) of 4 X'BX. The second 
factor would be the moment generating function M(«,0) of a'X if 
and only if it were independent of 8. But the necessary and 
sufficient condition for independence of any two functions with 


Moment generating function M(a,8) is 
M(a,8) = M(a,0)M(0,8) 


and so we get the desired criteria of independence as stated above. 

We apply this criteria to estimates x and 8° of mean 
and variance in a sample of n independent single values of 1- 
variate. Such situation occurs in the derivation of 


t-distribution 
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To avoid unnecessary complexity we may disregard the factor 


1/n and 1/(n-1) and consider the independence of 


n n 5 
) X, and ) (x, -x) 
i=l en ie 
Herer sa!’ s= 115 2... 5h} 1 and 
Te ee 
n n n 
_i gen & se 
n n n 
B = 
y nl 
vik Wy, wl tig 
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and V here is I the identity matrix. 


Clearly AEA is in this case the sum of all the a 


elements in Gactime. — 
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Write 
(I-8B) = (1-8)I + BM 


where M is the matrix having all elements equal to 1/n. Obviously 


M is idempotent. 


Therefore 


IT 1 


(I-8B) ~ = [(1-8)I + 6M] 


But 
[(l-a)E + eM)” = (1-8) [1-6M] (4.2) 
(see the lemma below). 
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aed ee 
n n n 
DEEN BE 
n n 
I - BM = 
eee ee 
n n n 


The sum of all elements in (I-8M) is n(1-8), and therefore 
the sum of all the elements in Cr=eBye- is equal to n, and hence by 
(*) AL Coches a is equal to n and thus independent of 8. 
Consequently it follows, x and an are independent. 


We conclude the proof by establishing the following 


lemma used in (4.2). 
Lemma: If Q is an idempotent matrix, then 


GEN e ue: or Q) o fic (*%) 


The lemma can easily be checked by pre- and post- multiply- 


2 
ing the right hand side of (**) and using Q =Q. 


III. In multiple regression models, the observation vector Y igs 
assumed to be N(XB,o°L_), where X is an (np) (p <n) matrix 
with known elements and of rank p, 8 isa (pxl) vector of 
unknown parameters, and BE is an unknown scalar. In these models 
it is often desired to test . hypotheses about elements of the 
vector §$. The technique often employed to devise test functions 
is the technique of analysis of variance. The procedure is to 


partition the total sum of squares Veen into quadratic forms 
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such that 


and use Cochran's theorem (Theorem 14) to ascertain the indepen- 


dence: and distribution of the quantities YAY. Since the 


use of Cochran's theorem involves the knowledge of ranks of A.» 


it is sometimes easy to invoke idempotency of A,'s and 


Craig's condition for independence of quadratic forms (Theorem 1). 


Consider the multiple regression model 
2 
Vo Ce. a ev N(O,o 1) 


X,B8 and Y as above. 


If we partition X and 8 as 
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where X) is of order np, anda) -1S) 4 Py xl vector, then the 


above model can be written as 


To test the hypothesis Ho : a = 0, we can form the ratio 


where u is distributed as F distribution with Py and n-p 


degrees of freedom. Q is minimum value of e'-e with respect to 
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full model and a = Q-Q,. where Q, is the minimum value of e'e 
with respect to reducedmodel under Ho: For its justification we 
proceed as follows: 


By minimization procedure it can be shown that 


Q = Y'(I-xs 7x')y = Y'AY 
and 


whyryy = Y'BY 


= ' = 
Q, = ¥'CI-X,8,°X, 


= y! Sex er ie ee en 
where S ete XX,» (I-XS “x') A and (1 XS, X,) B. 


2 
Now 
eae (1-xs7tx') (1-xs7tx') 
= (i-xs' xt = xs-'x! 4 xs=ox'xs 7x") 
= (1-xS7*x') = A. 
Therefore A is idempotent, similarly B is idempotent. 
Since 


x' (1-xs- +x") = 0 


- -1 
it is clear that X, (1-XS Tyr) = 0 and X, (1-xs X') = 0. These 


now imply that C is also idempotent, and AC = 0 where 


ES £, ce cee ie = val ae 
C = B-A = (1-X,5., X,) (I-xXS “X') 


Since the matrices A, B and C are idempotent, we have r(A) = n-p, 


r(B) = n-(p-p,;) and r(C) = r(B)-r(A) = p,. 


Now we are in a position to apply Theorem 20, and thus we 


have 
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2 2 
1. Q/o° = (Y'AY)/o” is distributed as x!" (n-p4A,) 
9 a 1 our. : A 2 
; Q,/9 = (Y¥'CY)/o is distributed as y' (p24 ) 
c 
3. Q and Q, are independent. 


4. A, = (1/207) (B'K"AKB) = 1/207 [8'X' (I-xs"*x") xB] = 0 


therefore o/s is distributed as re reais 
= ' ss ae t ra ar 
i (1/208 X'{(I-X,S, X,) - (I-KS “X") }x8] 
2 lyta ty? alee Tayt 
=(1/20° (a'X!+y'X3) {(I-X,85°X})-(I-XS"X") } (aX, +YX,)] 


= 2 t ty _y! = 
(1/20 )la (XX) Xj X,8, X,X,) 4] 


<j Z 
ly _ yt : ‘ oe ae 
Since XX, XjX,S5 XX) is positive definite, Q,/9 has 
central chi-square distribution if and only if a= 0, i.e., H 
is true. 
Hence = (Q,/Q)° [(n-p)/Py] is distributed as 


F'(py sn-P,A,) and reduces to central F distribution if and only 


if H is true. 
IV. In III we considered the model 
Y = XB + e 


where ev N(0,0°T) and X was of full rank. 

Now let us suppose that X is not of full rank. In such 
situation we proceed by finding a generalized inverse G Of XX" aXe 
Suppose our aim is to derive a suitable test statistics for testing 
H : XB = 0. By working with the minimization procedure (least 


square method) it can be shown residual error sum of squares is 
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SSE = Y(I-XGX')Y 


If we denote this quadratic form by Qa Andes Yale Vee 0. 


the. regression sum of squares (S.S.R) is given by 
5-S.R > Q-Q..m'% 'XGXlY 
Let us denote this quadratic form by Q,- Now 
Q, Jo" = Y¥' (I-XGX')¥/o* 


Since 671 (I-XGX") /o" = (I-XGX') and (I-XGX') is clearly 


idempotent. Therefore, by Theorem 20, we have 
2 7 ! ! 1 i] 2 
Q,/9 ~ x' [r(I-XGX') ,8'X' (I1-XGX')X8/20 J 


2 
or equalently Q,/o- v sf with n-r d.t., “where rr = rank of xX. 
Also because XGX' is idempotent and (xXGX')(1I-XGX') 
= 0, Theorem 20 together with Craig's theorem implies 


that Q,/0° is distributed independently of Q,/o" with 
2 2 ! i] 1 2 
Q,/o° ~ x! [r(XGX") , 8 XXGX'X8/20° ] 


Thus 
; Q,/x 
Aca 
follows non-central F-distribution with parameters r and n-r_ and 


Z 
non-centrality parameter 8'X'X8/20 . Hence u_ follows central 
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